1. Introduction and Goals

This project analyses the LendingClub's loan dataset. The dataset includes loan application data, the information on granted loans and their status. In total {ADD SIZE} loans are included in the dataset.

The goal of this project is build several ML models which can be used to predict:

• Binary loan_status prediction model. We have used XGBoost and CatBoost to build a model which can be used to predict how likely an applicant is to default on a loan based on their information and the loan size, type and other specifics. This model can be used to decide whether the application should be approved or used by a third party investor to estimate risk. The goal of this model is to maximize the quality of probability prediction rather than the classification accuracy itself. In addition to estimating the default likelihood we'll also use this model to estimate:
  • Loan grades (A,B,C etc.) based on probability threshold, this does not directly attempt to predict the grades defined in the dataset but rather can be used as an alternative method to classify loan risk
  • Using this model we'll calculate the profitability and risk of a loan portfolio if only and provide an improved (more restrictive) method of evaluating loan applicants
• loan_grade prediction models, we'll evaluate and compare two different approaches
  • Multi classification model using XGBoost and CatBoost
  • Regression model that attempts to predict grade converted to a normalized numerical variable (predictions are rounded). While using a regression model for a classification problem is not ideal because it ignores the fact that spacing between different classes of ordinal features might differ (e.g. we don't know if the distance between grade A and B is the same as between B and C etc.) {TODO finish}

Data Selection:

To limit the extent of this project we have only included loans which were fully paid back or have been default on by the lender in our analysis based on the loan_status column

1.1 Features

This is a supplement to the main EDA notebook (1.2 EDA) that includes the individual analysis of all numerical and categorical variables. The insights obtained here together with the analysis of interaction between individual variables was used to build the preprocessing pipeline and individual transformers (for feature engineering) that were used when building our models (see the EDA notebook for additional details).

With transform="pandas", `func` should return a DataFrame to follow the set_output API.

	term_parser__term	emp_length_parser__emp_length	target__grade	pass__loan_amnt	pass__int_rate	pass__installment	pass__sub_grade	pass__home_ownership	pass__annual_inc	pass__verification_status	pass__purpose	pass__zip_code	pass__addr_state	pass__dti	pass__delinq_2yrs	pass__fico_range_low	pass__fico_range_high	pass__inq_last_6mths	pass__mths_since_last_delinq	pass__mths_since_last_record	pass__open_acc	pass__pub_rec	pass__revol_bal	pass__revol_util	pass__total_acc	pass__initial_list_status	pass__last_fico_range_high	pass__last_fico_range_low	pass__collections_12_mths_ex_med	pass__mths_since_last_major_derog	pass__application_type	pass__annual_inc_joint	pass__dti_joint	pass__verification_status_joint	pass__inq_fi	pass__inq_last_12m	pass__chargeoff_within_12_mths	pass__mort_acc	pass__pub_rec_bankruptcies	pass__tax_liens	pass__tot_hi_cred_lim	pass__total_bal_ex_mort	pass__loan_status
2086299	36	1.0	0	14000.0	6.08	426.42	A2	MORTGAGE	70000.0	Not Verified	debt_consolidation	176xx	PA	31.10	0.0	800.0	804.0	0.0	NaN	NaN	18.0	0.0	22237.0	32.3	33.0	w	824.0	820.0	0.0	NaN	Joint App	350000.0	8.61	Not Verified	1.0	0.0	0.0	1.0	0.0	0.0	492126.0	78093.0	Current
1233152	60	NaN	4	35000.0	19.52	917.97	E2	MORTGAGE	120000.0	Verified	debt_consolidation	799xx	TX	23.75	1.0	710.0	714.0	3.0	22.0	NaN	11.0	0.0	49315.0	43.7	34.0	f	804.0	800.0	0.0	NaN	Individual	NaN	NaN	None	NaN	NaN	0.0	3.0	0.0	0.0	390414.0	90585.0	Fully Paid
461729	36	10.0	0	10000.0	7.34	310.33	A4	MORTGAGE	70000.0	Not Verified	debt_consolidation	063xx	CT	14.72	0.0	685.0	689.0	0.0	NaN	106.0	6.0	1.0	21943.0	47.5	16.0	w	749.0	745.0	0.0	NaN	Individual	NaN	NaN	None	0.0	0.0	0.0	1.0	1.0	0.0	56200.0	26022.0	Fully Paid
738295	60	10.0	3	21600.0	17.27	539.96	D2	MORTGAGE	96000.0	Verified	debt_consolidation	482xx	MI	15.83	1.0	690.0	694.0	1.0	15.0	NaN	11.0	0.0	14751.0	71.3	32.0	w	639.0	635.0	0.0	42.0	Individual	NaN	NaN	None	3.0	1.0	0.0	3.0	0.0	0.0	242183.0	76547.0	Fully Paid
864585	36	3.0	1	3300.0	10.07	106.60	B2	RENT	22000.0	Verified	other	490xx	MI	2.73	0.0	730.0	734.0	0.0	NaN	NaN	2.0	0.0	680.0	42.5	3.0	w	764.0	760.0	0.0	NaN	Individual	NaN	NaN	None	0.0	0.0	0.0	0.0	0.0	0.0	1600.0	680.0	Current

'Features with NaN Values:'

	Total NaN Values	Proportion NaN (%)
emp_length_parser__emp_length	1325	15.0
pass__dti	2	0.0
pass__mths_since_last_delinq	4587	51.0
pass__mths_since_last_record	7593	84.0
pass__revol_util	4	0.0
pass__mths_since_last_major_derog	6671	74.0
pass__annual_inc_joint	8545	95.0
pass__dti_joint	8545	95.0
pass__verification_status_joint	8556	95.0
pass__inq_fi	3422	38.0
pass__inq_last_12m	3422	38.0
pass__mort_acc	179	2.0
pass__pub_rec_bankruptcies	7	0.0
pass__tot_hi_cred_lim	275	3.0
pass__total_bal_ex_mort	179	2.0

	Total NaN Values	Proportion NaN (%)
pass__verification_status_joint	8556	95.0

count              444
unique               3
top       Not Verified
freq               212
Name: pass__verification_status_joint, dtype: object

set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.

set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.

A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy

A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.

set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.

A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.

A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy

A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy

set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.

set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.

A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.

A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.

With transform="pandas", `func` should return a DataFrame to follow the set_output API.

1.1 EDA

This is the exploratory analysis of the dataset and includes all the features shown in the (Features) notebook.

The EDA was done in parallel with model design process to minimize the influence analyzing manually analyzing the interaction between features might have had on our model design process.

Data selection

We have three target variables which we'll try to predict using in our following sections. They are shown here as:

• target_loan_status: whether the loan applicant has defaulted on their loan (0 or 1)
• pass_grade: the grade assigned to the loan by the "Lenders Club" (A,B,C,D etc.)
• pass_interest_rate: the interest rate set for the loan (converted to float)

['target__loan_status']

1.1.1 Correlation Matrix

Loan Status has strong correlation with:

• Applicant FICO (credit) score
• Term of the loan (longer loans are somewhat more to be defaulted on)
• While the correlation with the zip_code is almost 0.4 it is not significant (other variables like grade, sub_grade and interest rate are not included in our model because they are calculated based on estimated loan risk, we could still include them if our goal is to verify the quality of "Lenders Club" estimates we chose not to include them to build a "clean" alternative model using the same source data).

Loan Grade and Interest Rate have significant correlations with a much larger number of variables:

• Loan Term
• Loan amount and installment size
• FICO score
• Loan purpose
• Applicant income
• Income verification status etc.

This would indicate that the Lenders Club is trying to use a large number of variables to determine the grade and interest rate but that those variables are not necessarily as useful at predicting the likelihood of default.

Because the datatypes of features vary we had to use different methods to measure the strength and significance of each pair:

- Chi-Squared Test: Assesses independence between two categorical variables.  For bool-bool pairs due to categorical nature.

- Point Biserial Correlation: Measures correlation between a binary and a continuous variable. For bool-numerical pairs to account for mixed data types.

- Spearman's Rank Correlation: Assesses monotonic relationship between two continuous variables. Used for numerical-numerical pairs (for non-normally distributed data).

Since the Chi-Squared test outputs an unbound statistic/value which can't be directly compared to  pointbiserialr or Spearman Rank we have converted them to a  ` Cramér's V:` value which is normalized between 0 and 1. This was done to make the values in the matrix more uniform however we must note that Cramér's V and Spearman's correlation coefficients are fundamentally different statistics and generally can't be directly compared.

1.1.1 Relationships between individual variables

This part includes various charts showing the relationships between specific manually selected variables:

We can see that much fewer grade A and B loans were defaulted on while at C or below the likelihood of default becomes higher than average:

'Default Rate and Expected Return by Grade:'

	default_rate	mean_interest_rate	expected_return
pass__grade
A	0.07	7.09	6.60
B	0.13	10.65	9.24
C	0.22	14.00	10.87
D	0.31	17.79	12.23
E	0.38	21.16	13.03
F	0.50	25.12	12.46
G	0.57	27.74	11.98

The expected_return show the rate of return adjusted by the default rate. e.g. while almost 60% of all G grade loans are defaulted on you can still expect to make ~12% per year because the interest is very high. A grade loans tend to be relatively much less profitable despite the much lower risk.

Text(0.5, 1.025, 'Grade and Interest Rate')

There is quite a bit of overlap between interest rates for lower grades (D+).

Text(0.5, 1.025, 'Grade and Loan Amount')

Text(0.5, 1.025, 'Grade and Annual Income')

As we would expect the applications by individuals who tend to have very low incomes tend to receive lower grades. However, the rate of E grade loans increases significantly along with grade A > ~100k yearly income which is quite interesting and requires additional analysis because this does not apply to loans of other grades (we can see in charts below that the income of ~25% applicants is > 90k so this can't really be explained by random variation due to small sample size)

Text(0.5, 1.025, 'Grade and Fico Score')

Text(0.5, 1.025, 'Default Rate and Interest Rate')

Text(0.5, 1.025, 'Default Rate and Annual Income')

While low income individuals are much more likely to default the risk of default doesen't seems to decrease much or at as income goes up.

Text(0.5, 1.025, 'Loan Amount and Purpose')

term_parser__term: int64
target__loan_status: float64
pass__loan_amnt: float64
pass__int_rate: float64
pass__grade: object
pass__home_ownership: object
pass__annual_inc: float64
pass__purpose: object
pass__fico_range_high: float64
pass__last_fico_range_high: float64

	term_parser__term
1233152	60
461729	36
738295	60
390716	36
350813	60
...	...
701647	36
1093222	36
1231982	36
143267	36
208225	36

5361 rows × 1 columns

term_parser__term_binned             category
term_parser__term                       int64
target__loan_status_binned           category
target__loan_status                   float64
pass__loan_amnt_binned               category
pass__loan_amnt                       float64
pass__int_rate_binned                category
pass__int_rate                        float64
pass__annual_inc_binned              category
pass__annual_inc                      float64
pass__fico_range_high_binned         category
pass__fico_range_high                 float64
pass__last_fico_range_high_binned    category
pass__last_fico_range_high            float64
pass__grade                            object
pass__home_ownership                   object
pass__purpose                          object
dtype: object

None

None

None

None

None

None

None

None

None

None

None

None

None

None

None

None

None

None

'term_parser__term_binned vs pass__fico_range_high No significant difference found (p-value = 0.302)'

None

None

None

None

None

None

None

None

1233152    714.0
461729     689.0
738295     694.0
390716     704.0
350813     694.0
           ...  
701647     719.0
1093222    749.0
1231982    719.0
143267     759.0
208225     664.0
Name: pass__fico_range_high, Length: 5361, dtype: float64

2. Model Design

As we've discussed at the begining our goal is to build ML models to predict these target features:

• Loan Default Risk (loan_status)
• Loan Grade (loan_grade)
• Interest Rate (int_rate)

In all cases we've either used XGBoost or CatBoost models (based on performance and training time).

2.1. Model Pipelines

We've used sci-kit lear pipelines to build and design our models. The data passed to the pipeline is preprocessed separately in src/preproc which filters only completed loans (based on loan_status) and performs other clean up and preprocessing (without fundamentally transforming or scaling etc.) to make all the features compatible with our ML models.

Example of a pipeline:

Pipeline(steps=[('preprocessing',
                 FunctionTransformer(func=<function convert_to_category at 0x7f9a9fcefeb0>)),
                ('feat_trans_loan_grade', LoanGradeTransformer()),
                ('feat_trans_dti_inc_joint', JointApplicationTransformer()),
                ('feat_trans_loan_grade_risk', LoadGradeRiskTransformer()),
                ('feat_trans_fico_score', FICOScoreTransformer()),
                ('feat_trans_delinquency', Del...
                ('feat_trans_dummy_DROP_ALL_BUT_FICO_HIGH',
                 DummyDropAllButFICOHigh()),
                ('feat_trans_dummytransformer',
                 DummyTestTransformer(option=<Options.OFF: 0>)),
                ('remove_columns',
                 FunctionTransformer(func=<function get_pipeline.<locals>.remove_columns_with_prefix at 0x7f9b2668d990>,
                                     kw_args={'prefix': 'target__'})),
                ('model',
                 <catboost.core.CatBoostClassifier object at 0x7f9a9bb53e80>)])

In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.

Each pipeline consists of these steps:

• a preprocessing function which handles data encoding if necessary (we do not encode categorical variables because XGBoost and CatBoost support them directly).
• a set of feature transformers selected based on hyper tuning results (the transformers were designed iteratively while designing the model and performing the EDA). The transformer merge/combine or otherwise modify various features based on subject knowledge (e.g. calculating various ratios or merging variables which represent basically the same features etc.)
• ML model.

2.2 Hyper-tuning

Because the dataset is very large we have split the tuning and model evaluation into separate notebooks, so they can be performed independently:

• Hyper tuning is first performed using default or fixed model hyperparameters to select the optimal transformers and their parameters.
• Hyperparameter tuning is performed using a fixed pipeline with transformers selected in the previous step.

This is a compromise approach, ideally we would use two nested loops with grid search performed on the outer level to select the transformers and a nested loop (using random or bayesian search) for model hyper tuning. However, considering the size of the dataset (and even if we use a relatively large sample) would be very slow because it would exponentially increase the number of required iterations.

The results are serialized to a binary file that includes the information on the model and training dataset.

2.3 Model Evaluation

Is performed by loading the hyper tuning information saved in the previous step, the model (with the same pipeline) is trained using the test training sample of the dataset, validated using CV and then evaluating using a separate training sample.

2.4 Production Deployment

The model from the previous step is serialized using (dill or joblib) and deployed to remote VM running a FastAPI backend that can be integrated into a website or other application.

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/preprocessing/_function_transformer.py:345: UserWarning: With transform="pandas", `func` should return a DataFrame to follow the set_output API.
  warnings.warn(

Total Samples Loaded 5361

CatBoostF1: 8.0 seconds
XGBoostTuneF1: 3.4 seconds

/home/paulius/data/projects/m3_s3_lending/shared/graph.py:985: UserWarning: The figure layout has changed to tight
  plt.tight_layout()

/home/paulius/data/projects/m3_s3_lending/shared/graph.py:440: UserWarning: set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.
  ax.set_yticklabels(

/home/paulius/data/projects/m3_s3_lending/shared/graph.py:440: UserWarning: set_ticklabels() should only be used with a fixed number of ticks, i.e. after set_ticks() or using a FixedLocator.
  ax.set_yticklabels(

1233152    0.0
461729     0.0
738295     0.0
390716     0.0
350813     0.0
          ... 
701647     1.0
1093222    0.0
1231982    0.0
143267     1.0
208225     1.0
Name: target__loan_status, Length: 5361, dtype: float64

	Counts	Proportion	Loan_Status_Ratio
A	922	0.171983	0.069414
B	1601	0.298638	0.132417
C	1494	0.278679	0.223561
D	787	0.146801	0.312579
E	388	0.072375	0.384021
F	125	0.023317	0.504000
G	44	0.008207	0.568182

array(['A', 'B', 'C', 'D', 'E', 'F', 'G'], dtype=object)

[{'label': 'A Grade',
  'start': 0,
  'end': 0.06536286053488224,
  'color': 'grey',
  'description': ''},
 {'label': 'B Grade',
  'start': 0.06536286053488224,
  'end': 0.16896054342253738,
  'color': (0.9994925028835063, 0.9192618223760093, 0.6061361014994233),
  'description': ''},
 {'label': 'C Grade',
  'start': 0.16896054342253738,
  'end': 0.29968626449230185,
  'color': (0.996078431372549, 0.8065974625144174, 0.41494809688581313),
  'description': ''},
 {'label': 'D Grade',
  'start': 0.29968626449230185,
  'end': 0.4514541267304494,
  'color': (0.9944329104190696, 0.6371549404075355, 0.2717108804306036),
  'description': ''},
 {'label': 'E Grade',
  'start': 0.4514541267304494,
  'end': 0.6204146701529868,
  'color': (0.9898808150711266, 0.40955017301038066, 0.19432525951557092),
  'description': ''},
 {'label': 'F Grade',
  'start': 0.6204146701529868,
  'end': 0.8039114183953532,
  'color': (0.9186466743560169, 0.16113802383698578, 0.1257362552864283),
  'description': ''},
 {'label': 'G Grade',
  'start': 0.8039114183953532,
  'end': 1.0,
  'color': (0.7604613610149943, 0.013194925028835056, 0.14394463667820068),
  'description': ''}]

---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
Cell In[19], line 2
      1 cm_target_model_key = "XGBoostTunePRAUC"
----> 2 cm_target_model = cv_results_all_models[cm_target_model_key]
      4 target_cm_data = cm_target_model.cm_data
      5 target_cm_data.probabilities

KeyError: 'XGBoostTunePRAUC'

Calculating Probability Thresholds

If we're using our binary classification model to assign grades to loans based on default probabilities we can't directly try to predict the grades from the source dataset.

Basically what we can do is to use the source dataset as a baseline and try to determine whether our model can outperform the method the Lending Club is using for determine grades, we'll try to maintain the same ratio of grades while trying to minimize the default risk for loans included in top grades (basically we want to make sure that's the spread of default risk between grades is maximized i.e. default risk for grade A is as close to 0% and for grade F as close to 100% as possible while also ensuring that the risk increased with continuously with grade)

Limitations

We must take into account that this calculation is very simplified and therefore probably not accurate because, our model and calculations assume that Loss Given Default (LGD) is 100% and that Exposure at Default (EAD) is also 100% which is not accurate: - loans usually are not defaulted on immediately (i.e. some payments are almost always received) - most applicants who are unable to keep up with their payments are given some leeway and {PAYMENT PLAN} - failed loans are often sold to third parties for at least some fraction of the owed amount

Therefore, to provide a more accurate estimate and to figure out whether our model would actually be useful we'd need to incorporate the actual amounts received etc.

TODO: consider doing this (we'd just need to use the appropriate column from the df)

Tuning Loan Default Risk Classifier Model

This notebook is used to select the feature transformers and find optimal parameters for the ML model used for predicting the risk of loan default (see 1.2_Default_Prediction_Model.ipynb for a more detailed description).

This model is to be used to estimate the probability of default and to assign a risk grade and/or determine the appropriate interest rate based on it.

Sampled n: 10004

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/preprocessing/_function_transformer.py:345: UserWarning: With transform="pandas", `func` should return a DataFrame to follow the set_output API.
  warnings.warn(

<module 'shared.ml_config_runner' from '/home/paulius/data/projects/m3_s3_lending/shared/ml_config_runner.py'>

Run the tunning for selected XGBoost model config with these scoring metrics:

• log loss
• F1
• PR-AUC

Tunning: - transformers: transformers: 1
 total options: 3
[<class 'src.feature_engineering.LoanGradeTransformer'>]
search_grid:
{'feat_trans_loan_grade__option': [0, 1, 2]}

 - model: XGBoostTuneLogLoss n_iters=100 with:
 {'model__learning_rate': [0.01, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.9, 1], 'model__max_depth': [4, 5, 6, 7, 10, 12, None], 'model__n_estimators': [50, 100, 150, 200, 250], 'model__min_child_weight': [0.1, 0.25, 0.5, 0.75, 1, 1.5, 2, 2.5, 3], 'model__gamma': [0, 0.05, 0.1, 0.3, 0.4], 'model__scale_pos_weight': [1, 2, 3, 5, 10]}
Fitting 3 folds for each of 3 candidates, totalling 9 fits

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_search.py:307: UserWarning: The total space of parameters 3 is smaller than n_iter=5. Running 3 iterations. For exhaustive searches, use GridSearchCV.
  warnings.warn(

Best Transformer Parameters: {'feat_trans_loan_grade__option': 0}
Fitting 3 folds for each of 5 candidates, totalling 15 fits
Best Model Parameters: {'model__scale_pos_weight': 1, 'model__n_estimators': 50, 'model__min_child_weight': 2, 'model__max_depth': 6, 'model__learning_rate': 0.3, 'model__gamma': 0.3}

---------------------------------------------------------------------------
KeyboardInterrupt                         Traceback (most recent call last)
Cell In[3], line 5
      2 importlib.reload(pipeline)
      3 importlib.reload(ml_config_runner)
----> 5 r, transformer_tune_results = ml_config_runner.run_tuning_for_configs(
      6     model_config.get_config_classifier,
      7     features,
      8     labels,
      9     use_optuna=False)
     10 r

File ~/data/projects/m3_s3_lending/shared/ml_config_runner.py:44, in run_tuning_for_configs(get_config, features, labels, use_optuna, only_tune_transformers)
     41 sample_indices = features.index
     42 model_config = pipeline_config.model_config
---> 44 tunning_result = pipeline.run_tunning_for_config(
     45     model_key=model_name,
     46     pipeline_config=pipeline_config,
     47     features=features.loc[sample_indices],
     48     labels=labels.loc[sample_indices],
     49 )
     50 tunning_result.to_yaml()
     51 res[model_name] = tunning_result

File ~/data/projects/m3_s3_lending/shared/pipeline.py:733, in run_tunning_for_config(model_key, pipeline_config, features, labels, tune_type, cv)
    723 search_results = _tune_model_params(best_transformer_params, pipeline_config, features, labels, cv=3)
    725 tuning_results = _build_tuning_result(grid_search=search_results,
    726                                       model_key=model_key,
    727                                       features=features,
   (...)
    730                                       transformer_tune_results=transformer_tune_results
    731                                       )
--> 733 return tuning_results

File ~/data/projects/m3_s3_lending/shared/pipeline.py:733, in run_tunning_for_config(model_key, pipeline_config, features, labels, tune_type, cv)
    723 search_results = _tune_model_params(best_transformer_params, pipeline_config, features, labels, cv=3)
    725 tuning_results = _build_tuning_result(grid_search=search_results,
    726                                       model_key=model_key,
    727                                       features=features,
   (...)
    730                                       transformer_tune_results=transformer_tune_results
    731                                       )
--> 733 return tuning_results

File ~/.local/share/JetBrains/Toolbox/apps/pycharm-professional/plugins/python/helpers/pydev/_pydevd_bundle/pydevd_frame.py:755, in PyDBFrame.trace_dispatch(self, frame, event, arg)
    753 # if thread has a suspend flag, we suspend with a busy wait
    754 if info.pydev_state == STATE_SUSPEND:
--> 755     self.do_wait_suspend(thread, frame, event, arg)
    756     # No need to reset frame.f_trace to keep the same trace function.
    757     return self.trace_dispatch

File ~/.local/share/JetBrains/Toolbox/apps/pycharm-professional/plugins/python/helpers/pydev/_pydevd_bundle/pydevd_frame.py:412, in PyDBFrame.do_wait_suspend(self, *args, **kwargs)
    411 def do_wait_suspend(self, *args, **kwargs):
--> 412     self._args[0].do_wait_suspend(*args, **kwargs)

File ~/.local/share/JetBrains/Toolbox/apps/pycharm-professional/plugins/python/helpers/pydev/pydevd.py:1184, in PyDB.do_wait_suspend(self, thread, frame, event, arg, send_suspend_message, is_unhandled_exception)
   1181         from_this_thread.append(frame_id)
   1183 with self._threads_suspended_single_notification.notify_thread_suspended(thread_id, stop_reason):
-> 1184     self._do_wait_suspend(thread, frame, event, arg, suspend_type, from_this_thread)

File ~/.local/share/JetBrains/Toolbox/apps/pycharm-professional/plugins/python/helpers/pydev/pydevd.py:1199, in PyDB._do_wait_suspend(self, thread, frame, event, arg, suspend_type, from_this_thread)
   1196             self._call_mpl_hook()
   1198         self.process_internal_commands()
-> 1199         time.sleep(0.01)
   1201 self.cancel_async_evaluation(get_current_thread_id(thread), str(id(frame)))
   1203 # process any stepping instructions

KeyboardInterrupt: 

Total samples loaded : 607

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/preprocessing/_function_transformer.py:345: UserWarning: With transform="pandas", `func` should return a DataFrame to follow the set_output API.
  warnings.warn(

Tunning: - transformers: transformers: 10
 total options: 23
[<class 'src.feature_engineering.LoanGradeTransformer'>, <class 'src.feature_engineering.JointApplicationTransformer'>, <class 'src.feature_engineering.LoadGradeRiskTransformer'>, <class 'src.feature_engineering.FICOScoreTransformer'>, <class 'src.feature_engineering.DelinquencyTransformer'>, <class 'src.feature_engineering.InstallementIncomeRatio'>, <class 'src.feature_engineering.NewDtiTransformer'>, <class 'src.feature_engineering.LoanPurposeRiskTransformer'>, <class 'src.feature_engineering.DummyDropAllButFICOHigh'>, <class 'shared.ml_config_core.DummyTestTransformer'>]
search_grid:
{'feat_trans_loan_grade__option': [0, 1, 2], 'feat_trans_dti_inc_joint__option': [0, 1], 'feat_trans_loan_grade_risk__option': [0, 1, 2, 3], 'feat_trans_fico_score__option': [0, 1], 'feat_trans_delinquency__option': [0, 1], 'feat_trans_inst_income_ratio__option': [0, 1], 'feat_trans_new_dti_after_loan__option': [0, 1], 'feat_trans_loan_purpose__option': [0, 1], 'feat_trans_dummy_DROP_ALL_BUT_FICO_HIGH__option': [0, 1], 'feat_trans_dummytransformer__option': [0, 1]}

 - model: CatBoostF1 n_iters=80 with:
 {'model__scale_pos_weight': [5, 10, 15, 19, 25], 'model__depth': [6, 7, 8, 9, 10], 'model__learning_rate': [0.01, 0.03, 0.05, 0.1, 0.3], 'model__iterations': [100, 250, 500], 'model__l2_leaf_reg': [2, 3, 5]}
Fitting 3 folds for each of 3072 candidates, totalling 9216 fits

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py:425: FitFailedWarning: 
4608 fits failed out of a total of 9216.
The score on these train-test partitions for these parameters will be set to nan.
If these failures are not expected, you can try to debug them by setting error_score='raise'.

Below are more details about the failures:
--------------------------------------------------------------------------------
192 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 5100, in fit
    self._fit(X, y, cat_features, text_features, embedding_features, None, sample_weight, None, None, None, None, baseline, use_best_model,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 2303, in _fit
    train_params = self._prepare_train_params(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 2184, in _prepare_train_params
    train_pool = _build_train_pool(X, y, cat_features, text_features, embedding_features, pairs,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 1444, in _build_train_pool
    train_pool = Pool(X, y, cat_features=cat_features, text_features=text_features, embedding_features=embedding_features, pairs=pairs, weight=sample_weight, group_id=group_id,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 793, in __init__
    self._init(data, label, cat_features, text_features, embedding_features, embedding_features_data, pairs, weight,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 1425, in _init
    self._init_pool(data, label, cat_features, text_features, embedding_features, embedding_features_data, pairs, weight,
  File "_catboost.pyx", line 3976, in _catboost._PoolBase._init_pool
  File "_catboost.pyx", line 4026, in _catboost._PoolBase._init_pool
  File "_catboost.pyx", line 3842, in _catboost._PoolBase._init_features_order_layout_pool
  File "_catboost.pyx", line 2764, in _catboost._set_features_order_data_pd_data_frame
_catboost.CatBoostError: features data: pandas.DataFrame column 'pass__grade' has dtype 'category' but is not in  cat_features list

--------------------------------------------------------------------------------
1152 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 5100, in fit
    self._fit(X, y, cat_features, text_features, embedding_features, None, sample_weight, None, None, None, None, baseline, use_best_model,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 2303, in _fit
    train_params = self._prepare_train_params(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 2184, in _prepare_train_params
    train_pool = _build_train_pool(X, y, cat_features, text_features, embedding_features, pairs,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 1444, in _build_train_pool
    train_pool = Pool(X, y, cat_features=cat_features, text_features=text_features, embedding_features=embedding_features, pairs=pairs, weight=sample_weight, group_id=group_id,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 793, in __init__
    self._init(data, label, cat_features, text_features, embedding_features, embedding_features_data, pairs, weight,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 1425, in _init
    self._init_pool(data, label, cat_features, text_features, embedding_features, embedding_features_data, pairs, weight,
  File "_catboost.pyx", line 3976, in _catboost._PoolBase._init_pool
  File "_catboost.pyx", line 4026, in _catboost._PoolBase._init_pool
  File "_catboost.pyx", line 3842, in _catboost._PoolBase._init_features_order_layout_pool
  File "_catboost.pyx", line 2764, in _catboost._set_features_order_data_pd_data_frame
_catboost.CatBoostError: features data: pandas.DataFrame column 'pass__home_ownership' has dtype 'category' but is not in  cat_features list

--------------------------------------------------------------------------------
960 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 5100, in fit
    self._fit(X, y, cat_features, text_features, embedding_features, None, sample_weight, None, None, None, None, baseline, use_best_model,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 2303, in _fit
    train_params = self._prepare_train_params(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 2184, in _prepare_train_params
    train_pool = _build_train_pool(X, y, cat_features, text_features, embedding_features, pairs,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 1444, in _build_train_pool
    train_pool = Pool(X, y, cat_features=cat_features, text_features=text_features, embedding_features=embedding_features, pairs=pairs, weight=sample_weight, group_id=group_id,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 793, in __init__
    self._init(data, label, cat_features, text_features, embedding_features, embedding_features_data, pairs, weight,
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/catboost/core.py", line 1425, in _init
    self._init_pool(data, label, cat_features, text_features, embedding_features, embedding_features_data, pairs, weight,
  File "_catboost.pyx", line 3976, in _catboost._PoolBase._init_pool
  File "_catboost.pyx", line 4026, in _catboost._PoolBase._init_pool
  File "_catboost.pyx", line 3842, in _catboost._PoolBase._init_features_order_layout_pool
  File "_catboost.pyx", line 2764, in _catboost._set_features_order_data_pd_data_frame
_catboost.CatBoostError: features data: pandas.DataFrame column 'pass__sub_grade' has dtype 'category' but is not in  cat_features list

--------------------------------------------------------------------------------
2304 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 423, in fit
    Xt = self._fit(X, y, **fit_params_steps)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 377, in _fit
    X, fitted_transformer = fit_transform_one_cached(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/joblib/memory.py", line 353, in __call__
    return self.func(*args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 957, in _fit_transform_one
    res = transformer.fit_transform(X, y, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/utils/_set_output.py", line 157, in wrapped
    data_to_wrap = f(self, X, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 919, in fit_transform
    return self.fit(X, y, **fit_params).transform(X)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/utils/_set_output.py", line 157, in wrapped
    data_to_wrap = f(self, X, *args, **kwargs)
  File "/home/paulius/data/projects/m3_s3_lending/src/feature_engineering.py", line 218, in transform
    df = df[['pass__last_fico_range_high']].copy()
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/core/frame.py", line 3813, in __getitem__
    indexer = self.columns._get_indexer_strict(key, "columns")[1]
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6070, in _get_indexer_strict
    self._raise_if_missing(keyarr, indexer, axis_name)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6130, in _raise_if_missing
    raise KeyError(f"None of [{key}] are in the [{axis_name}]")
KeyError: "None of [Index(['pass__last_fico_range_high'], dtype='object')] are in the [columns]"

  warnings.warn(some_fits_failed_message, FitFailedWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_search.py:979: UserWarning: One or more of the test scores are non-finite: [nan nan nan ... nan nan nan]
  warnings.warn(

Best Transformer Parameters: {'feat_trans_delinquency__option': 0, 'feat_trans_dti_inc_joint__option': 0, 'feat_trans_dummy_DROP_ALL_BUT_FICO_HIGH__option': 1, 'feat_trans_dummytransformer__option': 0, 'feat_trans_fico_score__option': 0, 'feat_trans_inst_income_ratio__option': 0, 'feat_trans_loan_grade__option': 0, 'feat_trans_loan_grade_risk__option': 0, 'feat_trans_loan_purpose__option': 0, 'feat_trans_new_dti_after_loan__option': 0}
Fitting 3 folds for each of 5 candidates, totalling 15 fits
Best Model Parameters: {'model__scale_pos_weight': 10, 'model__learning_rate': 0.01, 'model__l2_leaf_reg': 5, 'model__iterations': 250, 'model__depth': 10}
Total time:1410.8

Tunning: - transformers: transformers: 10
 total options: 23
[<class 'src.feature_engineering.LoanGradeTransformer'>, <class 'src.feature_engineering.JointApplicationTransformer'>, <class 'src.feature_engineering.LoadGradeRiskTransformer'>, <class 'src.feature_engineering.FICOScoreTransformer'>, <class 'src.feature_engineering.DelinquencyTransformer'>, <class 'src.feature_engineering.InstallementIncomeRatio'>, <class 'src.feature_engineering.NewDtiTransformer'>, <class 'src.feature_engineering.LoanPurposeRiskTransformer'>, <class 'src.feature_engineering.DummyDropAllButFICOHigh'>, <class 'shared.ml_config_core.DummyTestTransformer'>]
search_grid:
{'feat_trans_loan_grade__option': [0, 1, 2], 'feat_trans_dti_inc_joint__option': [0, 1], 'feat_trans_loan_grade_risk__option': [0, 1, 2, 3], 'feat_trans_fico_score__option': [0, 1], 'feat_trans_delinquency__option': [0, 1], 'feat_trans_inst_income_ratio__option': [0, 1], 'feat_trans_new_dti_after_loan__option': [0, 1], 'feat_trans_loan_purpose__option': [0, 1], 'feat_trans_dummy_DROP_ALL_BUT_FICO_HIGH__option': [0, 1], 'feat_trans_dummytransformer__option': [0, 1]}

 - model: XGBoostTuneLogLoss n_iters=100 with:
 {'model__learning_rate': [0.01, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.9, 1], 'model__max_depth': [4, 5, 6, 7, 10, 12, None], 'model__n_estimators': [50, 100, 150, 200, 250], 'model__min_child_weight': [0.1, 0.25, 0.5, 0.75, 1, 1.5, 2, 2.5, 3], 'model__gamma': [0, 0.05, 0.1, 0.3, 0.4], 'model__scale_pos_weight': [1, 2, 3, 5, 10]}
Fitting 3 folds for each of 3072 candidates, totalling 9216 fits

Process LokyProcess-1:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/joblib/externals/loky/process_executor.py", line 370, in _sendback_result
    result_queue.put(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/joblib/externals/loky/backend/queues.py", line 235, in put
    with self._wlock:
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/joblib/externals/loky/backend/synchronize.py", line 119, in __enter__
    return self._semlock.acquire()
KeyboardInterrupt

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/joblib/externals/loky/process_executor.py", line 468, in _process_worker
    _sendback_result(result_queue, call_item.work_id, result=r)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/joblib/externals/loky/process_executor.py", line 375, in _sendback_result
    result_queue.put(_ResultItem(work_id, exception=exc))
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/joblib/externals/loky/backend/queues.py", line 235, in put
    with self._wlock:
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/joblib/externals/loky/backend/synchronize.py", line 119, in __enter__
    return self._semlock.acquire()
KeyboardInterrupt

KeyboardInterrupt

Total samples loaded : 9000

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/preprocessing/_function_transformer.py:345: UserWarning: With transform="pandas", `func` should return a DataFrame to follow the set_output API.
  warnings.warn(

---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
File ~/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/core/indexes/base.py:3802, in Index.get_loc(self, key, method, tolerance)
   3801 try:
-> 3802     return self._engine.get_loc(casted_key)
   3803 except KeyError as err:

File ~/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/_libs/index.pyx:138, in pandas._libs.index.IndexEngine.get_loc()

File ~/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/_libs/index.pyx:165, in pandas._libs.index.IndexEngine.get_loc()

File pandas/_libs/hashtable_class_helper.pxi:5745, in pandas._libs.hashtable.PyObjectHashTable.get_item()

File pandas/_libs/hashtable_class_helper.pxi:5753, in pandas._libs.hashtable.PyObjectHashTable.get_item()

KeyError: 'int_rate'

The above exception was the direct cause of the following exception:

KeyError                                  Traceback (most recent call last)
Cell In[13], line 1
----> 1 transformed_data['int_rate']

File ~/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/core/frame.py:3807, in DataFrame.__getitem__(self, key)
   3805 if self.columns.nlevels > 1:
   3806     return self._getitem_multilevel(key)
-> 3807 indexer = self.columns.get_loc(key)
   3808 if is_integer(indexer):
   3809     indexer = [indexer]

File ~/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/core/indexes/base.py:3804, in Index.get_loc(self, key, method, tolerance)
   3802     return self._engine.get_loc(casted_key)
   3803 except KeyError as err:
-> 3804     raise KeyError(key) from err
   3805 except TypeError:
   3806     # If we have a listlike key, _check_indexing_error will raise
   3807     #  InvalidIndexError. Otherwise we fall through and re-raise
   3808     #  the TypeError.
   3809     self._check_indexing_error(key)

KeyError: 'int_rate'

Tunning: - transformers: transformers: 7
 total options: 14
[<class 'src.feature_engineering.JointApplicationTransformer'>, <class 'src.feature_engineering.FICOScoreTransformer'>, <class 'src.feature_engineering.DelinquencyTransformer'>, <class 'src.feature_engineering.InstallementIncomeRatio'>, <class 'src.feature_engineering.NewDtiTransformer'>, <class 'src.feature_engineering.DummyDropAllButFICOHigh'>, <class 'shared.ml_config_core.DummyTestTransformer'>]
search_grid:
{'feat_trans_dti_inc_joint__option': [0, 1], 'feat_trans_fico_score__option': [0, 1], 'feat_trans_delinquency__option': [0, 1], 'feat_trans_inst_income_ratio__option': [0, 1], 'feat_trans_new_dti_after_loan__option': [0, 1], 'feat_trans_dummy_DROP_ALL_BUT_FICO_HIGH__option': [0, 1], 'feat_trans_dummytransformer__option': [0, 1]}

 - model: XGBoostOrdinalRegressor_Default n_iters=50 with:
 {'model__learning_rate': [0.01, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.9, 1], 'model__max_depth': [4, 5, 6, 7, 10, 12, None], 'model__n_estimators': [50, 100, 150, 200, 250], 'model__gamma': [0, 0.05, 0.1, 0.3, 0.4]}
Fitting 3 folds for each of 128 candidates, totalling 384 fits

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py:425: FitFailedWarning: 
120 fits failed out of a total of 384.
The score on these train-test partitions for these parameters will be set to nan.
If these failures are not expected, you can try to debug them by setting error_score='raise'.

Below are more details about the failures:
--------------------------------------------------------------------------------
4 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 1055, in fit
    train_dmatrix, evals = _wrap_evaluation_matrices(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 521, in _wrap_evaluation_matrices
    train_dmatrix = create_dmatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 958, in _create_dmatrix
    return QuantileDMatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1529, in __init__
    self._init(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1590, in _init
    _check_call(ret)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 282, in _check_call
    raise XGBoostError(py_str(_LIB.XGBGetLastError()))
xgboost.core.XGBoostError: [15:25:53] /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/data/../common/../data/gradient_index.h:94: Check failed: valid: Input data contains `inf` or a value too large, while `missing` is not set to `inf`
Stack trace:
  [bt] (0) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x6e) [0x7fb7a0f8c2ee]
  [bt] (1) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e0e44) [0x7fb7a11e0e44]
  [bt] (2) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(void xgboost::GHistIndexMatrix::PushAdapterBatch<xgboost::data::ArrayAdapterBatch>(xgboost::Context const*, unsigned long, unsigned long, xgboost::data::ArrayAdapterBatch const&, float, xgboost::common::Span<xgboost::FeatureType const, 18446744073709551615ul>, double, unsigned long)+0x705) [0x7fb7a11f3c05]
  [bt] (3) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e4d72) [0x7fb7a11e4d72]
  [bt] (4) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::InitFromCPU(xgboost::Context const*, xgboost::BatchParam const&, void*, float, std::shared_ptr<xgboost::DMatrix>)+0x2195) [0x7fb7a11e70c5]
  [bt] (5) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::IterativeDMatrix(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x73b) [0x7fb7a11e91fb]
  [bt] (6) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::DMatrix* xgboost::DMatrix::Create<void*, void*, void (void*), int (void*)>(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x7e) [0x7fb7a11995be]
  [bt] (7) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(XGQuantileDMatrixCreateFromCallback+0x1b7) [0x7fb7a0f7fab7]
  [bt] (8) /home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/lib-dynload/../../libffi.so.8(+0x6a4a) [0x7fb7b07e7a4a]



--------------------------------------------------------------------------------
2 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 1055, in fit
    train_dmatrix, evals = _wrap_evaluation_matrices(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 521, in _wrap_evaluation_matrices
    train_dmatrix = create_dmatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 958, in _create_dmatrix
    return QuantileDMatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1529, in __init__
    self._init(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1590, in _init
    _check_call(ret)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 282, in _check_call
    raise XGBoostError(py_str(_LIB.XGBGetLastError()))
xgboost.core.XGBoostError: [15:25:53] /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/data/../common/../data/gradient_index.h:94: Check failed: valid: Input data contains `inf` or a value too large, while `missing` is not set to `inf`
Stack trace:
  [bt] (0) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x6e) [0x7f2bce58c2ee]
  [bt] (1) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e0e44) [0x7f2bce7e0e44]
  [bt] (2) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(void xgboost::GHistIndexMatrix::PushAdapterBatch<xgboost::data::ArrayAdapterBatch>(xgboost::Context const*, unsigned long, unsigned long, xgboost::data::ArrayAdapterBatch const&, float, xgboost::common::Span<xgboost::FeatureType const, 18446744073709551615ul>, double, unsigned long)+0x705) [0x7f2bce7f3c05]
  [bt] (3) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e4d72) [0x7f2bce7e4d72]
  [bt] (4) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::InitFromCPU(xgboost::Context const*, xgboost::BatchParam const&, void*, float, std::shared_ptr<xgboost::DMatrix>)+0x2195) [0x7f2bce7e70c5]
  [bt] (5) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::IterativeDMatrix(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x73b) [0x7f2bce7e91fb]
  [bt] (6) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::DMatrix* xgboost::DMatrix::Create<void*, void*, void (void*), int (void*)>(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x7e) [0x7f2bce7995be]
  [bt] (7) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(XGQuantileDMatrixCreateFromCallback+0x1b7) [0x7f2bce57fab7]
  [bt] (8) /home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/lib-dynload/../../libffi.so.8(+0x6a4a) [0x7f2bf3c08a4a]



--------------------------------------------------------------------------------
3 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 1055, in fit
    train_dmatrix, evals = _wrap_evaluation_matrices(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 521, in _wrap_evaluation_matrices
    train_dmatrix = create_dmatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 958, in _create_dmatrix
    return QuantileDMatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1529, in __init__
    self._init(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1590, in _init
    _check_call(ret)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 282, in _check_call
    raise XGBoostError(py_str(_LIB.XGBGetLastError()))
xgboost.core.XGBoostError: [15:25:58] /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/data/../common/../data/gradient_index.h:94: Check failed: valid: Input data contains `inf` or a value too large, while `missing` is not set to `inf`
Stack trace:
  [bt] (0) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x6e) [0x7f8f8cf8c2ee]
  [bt] (1) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e0e44) [0x7f8f8d1e0e44]
  [bt] (2) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(void xgboost::GHistIndexMatrix::PushAdapterBatch<xgboost::data::ArrayAdapterBatch>(xgboost::Context const*, unsigned long, unsigned long, xgboost::data::ArrayAdapterBatch const&, float, xgboost::common::Span<xgboost::FeatureType const, 18446744073709551615ul>, double, unsigned long)+0x705) [0x7f8f8d1f3c05]
  [bt] (3) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e4d72) [0x7f8f8d1e4d72]
  [bt] (4) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::InitFromCPU(xgboost::Context const*, xgboost::BatchParam const&, void*, float, std::shared_ptr<xgboost::DMatrix>)+0x2195) [0x7f8f8d1e70c5]
  [bt] (5) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::IterativeDMatrix(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x73b) [0x7f8f8d1e91fb]
  [bt] (6) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::DMatrix* xgboost::DMatrix::Create<void*, void*, void (void*), int (void*)>(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x7e) [0x7f8f8d1995be]
  [bt] (7) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(XGQuantileDMatrixCreateFromCallback+0x1b7) [0x7f8f8cf7fab7]
  [bt] (8) /home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/lib-dynload/../../libffi.so.8(+0x6a4a) [0x7f8fb177ea4a]



--------------------------------------------------------------------------------
2 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 1055, in fit
    train_dmatrix, evals = _wrap_evaluation_matrices(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 521, in _wrap_evaluation_matrices
    train_dmatrix = create_dmatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 958, in _create_dmatrix
    return QuantileDMatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1529, in __init__
    self._init(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1590, in _init
    _check_call(ret)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 282, in _check_call
    raise XGBoostError(py_str(_LIB.XGBGetLastError()))
xgboost.core.XGBoostError: [15:25:58] /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/data/../common/../data/gradient_index.h:94: Check failed: valid: Input data contains `inf` or a value too large, while `missing` is not set to `inf`
Stack trace:
  [bt] (0) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x6e) [0x7fb7a0f8c2ee]
  [bt] (1) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e0e44) [0x7fb7a11e0e44]
  [bt] (2) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(void xgboost::GHistIndexMatrix::PushAdapterBatch<xgboost::data::ArrayAdapterBatch>(xgboost::Context const*, unsigned long, unsigned long, xgboost::data::ArrayAdapterBatch const&, float, xgboost::common::Span<xgboost::FeatureType const, 18446744073709551615ul>, double, unsigned long)+0x705) [0x7fb7a11f3c05]
  [bt] (3) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e4d72) [0x7fb7a11e4d72]
  [bt] (4) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::InitFromCPU(xgboost::Context const*, xgboost::BatchParam const&, void*, float, std::shared_ptr<xgboost::DMatrix>)+0x2195) [0x7fb7a11e70c5]
  [bt] (5) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::IterativeDMatrix(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x73b) [0x7fb7a11e91fb]
  [bt] (6) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::DMatrix* xgboost::DMatrix::Create<void*, void*, void (void*), int (void*)>(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x7e) [0x7fb7a11995be]
  [bt] (7) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(XGQuantileDMatrixCreateFromCallback+0x1b7) [0x7fb7a0f7fab7]
  [bt] (8) /home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/lib-dynload/../../libffi.so.8(+0x6a4a) [0x7fb7b07e7a4a]



--------------------------------------------------------------------------------
1 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 1055, in fit
    train_dmatrix, evals = _wrap_evaluation_matrices(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 521, in _wrap_evaluation_matrices
    train_dmatrix = create_dmatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 958, in _create_dmatrix
    return QuantileDMatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1529, in __init__
    self._init(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1590, in _init
    _check_call(ret)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 282, in _check_call
    raise XGBoostError(py_str(_LIB.XGBGetLastError()))
xgboost.core.XGBoostError: [15:25:58] /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/data/../common/../data/gradient_index.h:94: Check failed: valid: Input data contains `inf` or a value too large, while `missing` is not set to `inf`
Stack trace:
  [bt] (0) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x6e) [0x7f2bce58c2ee]
  [bt] (1) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e0e44) [0x7f2bce7e0e44]
  [bt] (2) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(void xgboost::GHistIndexMatrix::PushAdapterBatch<xgboost::data::ArrayAdapterBatch>(xgboost::Context const*, unsigned long, unsigned long, xgboost::data::ArrayAdapterBatch const&, float, xgboost::common::Span<xgboost::FeatureType const, 18446744073709551615ul>, double, unsigned long)+0x705) [0x7f2bce7f3c05]
  [bt] (3) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e4d72) [0x7f2bce7e4d72]
  [bt] (4) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::InitFromCPU(xgboost::Context const*, xgboost::BatchParam const&, void*, float, std::shared_ptr<xgboost::DMatrix>)+0x2195) [0x7f2bce7e70c5]
  [bt] (5) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::IterativeDMatrix(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x73b) [0x7f2bce7e91fb]
  [bt] (6) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::DMatrix* xgboost::DMatrix::Create<void*, void*, void (void*), int (void*)>(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x7e) [0x7f2bce7995be]
  [bt] (7) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(XGQuantileDMatrixCreateFromCallback+0x1b7) [0x7f2bce57fab7]
  [bt] (8) /home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/lib-dynload/../../libffi.so.8(+0x6a4a) [0x7f2bf3c08a4a]



--------------------------------------------------------------------------------
96 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 423, in fit
    Xt = self._fit(X, y, **fit_params_steps)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 377, in _fit
    X, fitted_transformer = fit_transform_one_cached(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/joblib/memory.py", line 353, in __call__
    return self.func(*args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 957, in _fit_transform_one
    res = transformer.fit_transform(X, y, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/utils/_set_output.py", line 157, in wrapped
    data_to_wrap = f(self, X, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 919, in fit_transform
    return self.fit(X, y, **fit_params).transform(X)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/utils/_set_output.py", line 157, in wrapped
    data_to_wrap = f(self, X, *args, **kwargs)
  File "/home/paulius/data/projects/m3_s3_lending/src/feature_engineering.py", line 218, in transform
    df = df[['pass__last_fico_range_high']].copy()
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/core/frame.py", line 3813, in __getitem__
    indexer = self.columns._get_indexer_strict(key, "columns")[1]
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6070, in _get_indexer_strict
    self._raise_if_missing(keyarr, indexer, axis_name)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6130, in _raise_if_missing
    raise KeyError(f"None of [{key}] are in the [{axis_name}]")
KeyError: "None of [Index(['pass__last_fico_range_high'], dtype='object')] are in the [columns]"

--------------------------------------------------------------------------------
6 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 1055, in fit
    train_dmatrix, evals = _wrap_evaluation_matrices(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 521, in _wrap_evaluation_matrices
    train_dmatrix = create_dmatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 958, in _create_dmatrix
    return QuantileDMatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1529, in __init__
    self._init(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1590, in _init
    _check_call(ret)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 282, in _check_call
    raise XGBoostError(py_str(_LIB.XGBGetLastError()))
xgboost.core.XGBoostError: [15:26:11] /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/data/../common/../data/gradient_index.h:94: Check failed: valid: Input data contains `inf` or a value too large, while `missing` is not set to `inf`
Stack trace:
  [bt] (0) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x6e) [0x7f6c28d8c2ee]
  [bt] (1) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e0e44) [0x7f6c28fe0e44]
  [bt] (2) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(void xgboost::GHistIndexMatrix::PushAdapterBatch<xgboost::data::ArrayAdapterBatch>(xgboost::Context const*, unsigned long, unsigned long, xgboost::data::ArrayAdapterBatch const&, float, xgboost::common::Span<xgboost::FeatureType const, 18446744073709551615ul>, double, unsigned long)+0x705) [0x7f6c28ff3c05]
  [bt] (3) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e4d72) [0x7f6c28fe4d72]
  [bt] (4) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::InitFromCPU(xgboost::Context const*, xgboost::BatchParam const&, void*, float, std::shared_ptr<xgboost::DMatrix>)+0x2195) [0x7f6c28fe70c5]
  [bt] (5) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::IterativeDMatrix(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x73b) [0x7f6c28fe91fb]
  [bt] (6) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::DMatrix* xgboost::DMatrix::Create<void*, void*, void (void*), int (void*)>(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x7e) [0x7f6c28f995be]
  [bt] (7) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(XGQuantileDMatrixCreateFromCallback+0x1b7) [0x7f6c28d7fab7]
  [bt] (8) /home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/lib-dynload/../../libffi.so.8(+0x6a4a) [0x7f6c4db42a4a]



--------------------------------------------------------------------------------
5 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 1055, in fit
    train_dmatrix, evals = _wrap_evaluation_matrices(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 521, in _wrap_evaluation_matrices
    train_dmatrix = create_dmatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 958, in _create_dmatrix
    return QuantileDMatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1529, in __init__
    self._init(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1590, in _init
    _check_call(ret)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 282, in _check_call
    raise XGBoostError(py_str(_LIB.XGBGetLastError()))
xgboost.core.XGBoostError: [15:26:15] /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/data/../common/../data/gradient_index.h:94: Check failed: valid: Input data contains `inf` or a value too large, while `missing` is not set to `inf`
Stack trace:
  [bt] (0) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x6e) [0x7ffb5038c2ee]
  [bt] (1) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e0e44) [0x7ffb505e0e44]
  [bt] (2) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(void xgboost::GHistIndexMatrix::PushAdapterBatch<xgboost::data::ArrayAdapterBatch>(xgboost::Context const*, unsigned long, unsigned long, xgboost::data::ArrayAdapterBatch const&, float, xgboost::common::Span<xgboost::FeatureType const, 18446744073709551615ul>, double, unsigned long)+0x705) [0x7ffb505f3c05]
  [bt] (3) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e4d72) [0x7ffb505e4d72]
  [bt] (4) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::InitFromCPU(xgboost::Context const*, xgboost::BatchParam const&, void*, float, std::shared_ptr<xgboost::DMatrix>)+0x2195) [0x7ffb505e70c5]
  [bt] (5) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::IterativeDMatrix(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x73b) [0x7ffb505e91fb]
  [bt] (6) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::DMatrix* xgboost::DMatrix::Create<void*, void*, void (void*), int (void*)>(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x7e) [0x7ffb505995be]
  [bt] (7) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(XGQuantileDMatrixCreateFromCallback+0x1b7) [0x7ffb5037fab7]
  [bt] (8) /home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/lib-dynload/../../libffi.so.8(+0x6a4a) [0x7ffb74b99a4a]



--------------------------------------------------------------------------------
1 fits failed with the following error:
Traceback (most recent call last):
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_validation.py", line 729, in _fit_and_score
    estimator.fit(X_train, y_train, **fit_params)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/base.py", line 1152, in wrapper
    return fit_method(estimator, *args, **kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/pipeline.py", line 427, in fit
    self._final_estimator.fit(Xt, y, **fit_params_last_step)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 1055, in fit
    train_dmatrix, evals = _wrap_evaluation_matrices(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 521, in _wrap_evaluation_matrices
    train_dmatrix = create_dmatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/sklearn.py", line 958, in _create_dmatrix
    return QuantileDMatrix(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 730, in inner_f
    return func(**kwargs)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1529, in __init__
    self._init(
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 1590, in _init
    _check_call(ret)
  File "/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py", line 282, in _check_call
    raise XGBoostError(py_str(_LIB.XGBGetLastError()))
xgboost.core.XGBoostError: [15:26:16] /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/data/../common/../data/gradient_index.h:94: Check failed: valid: Input data contains `inf` or a value too large, while `missing` is not set to `inf`
Stack trace:
  [bt] (0) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x6e) [0x7ffb5038c2ee]
  [bt] (1) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e0e44) [0x7ffb505e0e44]
  [bt] (2) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(void xgboost::GHistIndexMatrix::PushAdapterBatch<xgboost::data::ArrayAdapterBatch>(xgboost::Context const*, unsigned long, unsigned long, xgboost::data::ArrayAdapterBatch const&, float, xgboost::common::Span<xgboost::FeatureType const, 18446744073709551615ul>, double, unsigned long)+0x705) [0x7ffb505f3c05]
  [bt] (3) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(+0x3e4d72) [0x7ffb505e4d72]
  [bt] (4) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::InitFromCPU(xgboost::Context const*, xgboost::BatchParam const&, void*, float, std::shared_ptr<xgboost::DMatrix>)+0x2195) [0x7ffb505e70c5]
  [bt] (5) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::data::IterativeDMatrix::IterativeDMatrix(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x73b) [0x7ffb505e91fb]
  [bt] (6) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(xgboost::DMatrix* xgboost::DMatrix::Create<void*, void*, void (void*), int (void*)>(void*, void*, std::shared_ptr<xgboost::DMatrix>, void (*)(void*), int (*)(void*), float, int, int)+0x7e) [0x7ffb505995be]
  [bt] (7) /home/paulius/miniconda3/envs/rapids_v2/lib/libxgboost.so(XGQuantileDMatrixCreateFromCallback+0x1b7) [0x7ffb5037fab7]
  [bt] (8) /home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/lib-dynload/../../libffi.so.8(+0x6a4a) [0x7ffb74b99a4a]



  warnings.warn(some_fits_failed_message, FitFailedWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/model_selection/_search.py:979: UserWarning: One or more of the test scores are non-finite: [-0.87363029 -0.87509479         nan         nan -0.87363029 -0.87509479
         nan         nan -1.72207767 -1.71942101 -1.7133197  -1.71514919
 -1.7172781  -1.72644367 -1.71987797 -1.71885719 -1.51405631 -1.51405631
 -1.51405631 -1.51405631         nan         nan         nan         nan
 -1.71967355 -1.72630313 -1.72415312 -1.72231712         nan         nan
         nan         nan -0.85452965 -0.88326667 -0.85496037 -0.84901225
 -0.85452965 -0.88326667 -0.85496037 -0.84901225 -1.7180009  -1.71998987
 -1.72206904 -1.72641705 -1.72136705 -1.72356449 -1.71791662 -1.71959939
 -1.51405631 -1.51405631 -1.51405631 -1.51405631         nan         nan
         nan         nan -1.70949383 -1.72283924 -1.71918417 -1.72161215
         nan         nan         nan         nan -0.87680197 -0.87181571
         nan         nan -0.87680197 -0.87181571         nan         nan
 -1.7161081  -1.72149256 -1.71580945 -1.71319192 -1.71966207 -1.71581861
 -1.71670008 -1.71812548 -1.51405631 -1.51405631 -1.51405631 -1.51405631
         nan         nan         nan         nan -1.71739972 -1.72533995
 -1.72940832 -1.71520474         nan         nan         nan         nan
 -0.86956395 -0.86978519 -0.85937611 -0.84802341 -0.86956395 -0.86978519
 -0.85937611 -0.84802341 -1.71937517 -1.71975672 -1.72474271 -1.71839774
 -1.72055199 -1.71705395 -1.71077587 -1.71396156 -1.51405631 -1.51405631
 -1.51405631 -1.51405631         nan         nan         nan         nan
 -1.72352378 -1.72694304 -1.71671197 -1.72593799         nan         nan
         nan         nan]
  warnings.warn(

Best Transformer Parameters: {'feat_trans_delinquency__option': 1, 'feat_trans_dti_inc_joint__option': 1, 'feat_trans_dummy_DROP_ALL_BUT_FICO_HIGH__option': 0, 'feat_trans_dummytransformer__option': 0, 'feat_trans_fico_score__option': 0, 'feat_trans_inst_income_ratio__option': 1, 'feat_trans_new_dti_after_loan__option': 1}
Fitting 3 folds for each of 5 candidates, totalling 15 fits
Best Model Parameters: {'model__n_estimators': 200, 'model__max_depth': 4, 'model__learning_rate': 0.4, 'model__gamma': 0.1}
Total time:51.5

	best_score	best_params	mean_squared_error	r2_score
model_key
XGBoostOrdinalRegressor_Default	-0.134366	{'feat_trans_delinquency__option': 1, 'feat_tr...	0.01459	0.990763

2

'\n Model: XGBoostOrdinalRegressor_Default'

	feat_trans_delinquency__option	feat_trans_dti_inc_joint__option	feat_trans_dummy_DROP_ALL_BUT_FICO_HIGH__option	feat_trans_dummytransformer__option	feat_trans_fico_score__option	feat_trans_inst_income_ratio__option	feat_trans_new_dti_after_loan__option	mean_test_score
0	0	0	0	0	0	0	0	-0.088187
1	0	0	0	0	0	0	1	-0.089213
2	0	0	0	0	0	1	0	NaN
3	0	0	0	0	0	1	1	NaN
4	0	0	0	0	1	0	0	-0.088187
...	...	...	...	...	...	...	...	...
123	1	1	1	1	0	1	1	-1.719238
124	1	1	1	1	1	0	0	NaN
125	1	1	1	1	1	0	1	NaN
126	1	1	1	1	1	1	0	NaN
127	1	1	1	1	1	1	1	NaN

128 rows × 8 columns

'Transformer impact for XGBoostOrdinalRegressor_Default'

	Transformer_Option	Impact
1	feat_trans_dti_inc_joint__option_1	0.0637
0	feat_trans_delinquency__option_1	0.0004
4	feat_trans_fico_score__option_1	0.0000
6	feat_trans_new_dti_after_loan__option_1	-0.0022
5	feat_trans_inst_income_ratio__option_1	-0.0644
2	feat_trans_dummy_DROP_ALL_BUT_FICO_HIGH__option_1	-0.6640
3	feat_trans_dummytransformer__option_1	-1.0930

XGBoostOrdinalRegressor_Default

Total samples loaded : 9000

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/preprocessing/_function_transformer.py:345: UserWarning: With transform="pandas", `func` should return a DataFrame to follow the set_output API.
  warnings.warn(

Total Samples Loaded 9000

	term_parser__term	emp_length_parser__emp_length	target__grade	pass__loan_amnt	pass__installment	pass__home_ownership	pass__annual_inc	pass__verification_status	pass__purpose	pass__zip_code	pass__addr_state	pass__dti	pass__delinq_2yrs	pass__fico_range_low	pass__fico_range_high	pass__inq_last_6mths	pass__mths_since_last_delinq	pass__mths_since_last_record	pass__open_acc	pass__pub_rec	pass__revol_bal	pass__revol_util	pass__total_acc	pass__initial_list_status	pass__last_fico_range_high	pass__last_fico_range_low	pass__collections_12_mths_ex_med	pass__mths_since_last_major_derog	pass__application_type	pass__annual_inc_joint	pass__dti_joint	pass__verification_status_joint	pass__inq_fi	pass__inq_last_12m	pass__chargeoff_within_12_mths	pass__mort_acc	pass__pub_rec_bankruptcies	pass__tax_liens	pass__tot_hi_cred_lim	pass__total_bal_ex_mort
2086299	36	1.0	0	14000.0	426.42	MORTGAGE	70000.00	Not Verified	debt_consolidation	176xx	PA	31.10	0.0	800.0	804.0	0.0	NaN	NaN	18.0	0.0	22237.0	32.3	33.0	w	824.0	820.0	0.0	NaN	Joint App	350000.0	8.61	Not Verified	1.0	0.0	0.0	1.0	0.0	0.0	492126.0	78093.0
1233152	60	NaN	4	35000.0	917.97	MORTGAGE	120000.00	Verified	debt_consolidation	799xx	TX	23.75	1.0	710.0	714.0	3.0	22.0	NaN	11.0	0.0	49315.0	43.7	34.0	f	804.0	800.0	0.0	NaN	Individual	NaN	NaN	None	NaN	NaN	0.0	3.0	0.0	0.0	390414.0	90585.0
461729	36	10.0	0	10000.0	310.33	MORTGAGE	70000.00	Not Verified	debt_consolidation	063xx	CT	14.72	0.0	685.0	689.0	0.0	NaN	106.0	6.0	1.0	21943.0	47.5	16.0	w	749.0	745.0	0.0	NaN	Individual	NaN	NaN	None	0.0	0.0	0.0	1.0	1.0	0.0	56200.0	26022.0
738295	60	10.0	3	21600.0	539.96	MORTGAGE	96000.00	Verified	debt_consolidation	482xx	MI	15.83	1.0	690.0	694.0	1.0	15.0	NaN	11.0	0.0	14751.0	71.3	32.0	w	639.0	635.0	0.0	42.0	Individual	NaN	NaN	None	3.0	1.0	0.0	3.0	0.0	0.0	242183.0	76547.0
864585	36	3.0	1	3300.0	106.60	RENT	22000.00	Verified	other	490xx	MI	2.73	0.0	730.0	734.0	0.0	NaN	NaN	2.0	0.0	680.0	42.5	3.0	w	764.0	760.0	0.0	NaN	Individual	NaN	NaN	None	0.0	0.0	0.0	0.0	0.0	0.0	1600.0	680.0
...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...
1363363	36	10.0	1	8000.0	264.96	MORTGAGE	136000.00	Not Verified	home_improvement	318xx	GA	21.85	6.0	695.0	699.0	0.0	11.0	NaN	6.0	0.0	1801.0	72.0	21.0	w	689.0	685.0	0.0	11.0	Individual	NaN	NaN	None	0.0	1.0	0.0	6.0	0.0	0.0	356754.0	20772.0
1132562	60	10.0	1	28000.0	587.92	MORTGAGE	110000.00	Source Verified	debt_consolidation	327xx	FL	18.39	0.0	735.0	739.0	0.0	NaN	NaN	18.0	0.0	17120.0	23.9	39.0	w	724.0	720.0	0.0	NaN	Individual	NaN	NaN	None	NaN	NaN	0.0	4.0	0.0	0.0	521107.0	77152.0
143267	36	2.0	0	5000.0	156.43	RENT	10800.00	Source Verified	debt_consolidation	927xx	CA	20.78	0.0	755.0	759.0	0.0	NaN	NaN	6.0	0.0	5143.0	26.4	8.0	w	604.0	600.0	0.0	NaN	Individual	NaN	NaN	None	NaN	NaN	0.0	0.0	0.0	0.0	26500.0	12105.0
208225	36	1.0	3	6000.0	212.58	RENT	26000.00	Source Verified	moving	082xx	NJ	23.85	0.0	660.0	664.0	1.0	24.0	NaN	12.0	0.0	6158.0	82.1	24.0	f	564.0	560.0	0.0	24.0	Individual	NaN	NaN	None	NaN	NaN	0.0	0.0	0.0	0.0	24100.0	21421.0
1704932	36	NaN	2	7825.0	271.22	RENT	32669.61	Not Verified	debt_consolidation	968xx	HI	33.39	0.0	725.0	729.0	0.0	73.0	NaN	10.0	0.0	3167.0	16.5	18.0	w	794.0	790.0	0.0	NaN	Individual	NaN	NaN	None	0.0	0.0	0.0	0.0	0.0	0.0	42400.0	18490.0

9000 rows × 40 columns

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:47] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:47] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:47] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:47] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:47] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:52] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:52] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:26:58] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)

XGBoostTunePRAUCGradeClass: 15.2 seconds

Index(['term_parser__term', 'emp_length_parser__emp_length', 'target__grade', 'pass__loan_amnt', 'pass__installment', 'pass__home_ownership', 'pass__annual_inc', 'pass__verification_status', 'pass__purpose', 'pass__zip_code', 'pass__addr_state', 'pass__dti', 'pass__delinq_2yrs', 'pass__fico_range_low', 'pass__fico_range_high', 'pass__inq_last_6mths', 'pass__mths_since_last_delinq', 'pass__mths_since_last_record', 'pass__open_acc', 'pass__pub_rec', 'pass__revol_bal', 'pass__revol_util', 'pass__total_acc', 'pass__initial_list_status', 'pass__last_fico_range_high', 'pass__last_fico_range_low', 'pass__collections_12_mths_ex_med', 'pass__mths_since_last_major_derog', 'pass__application_type', 'pass__annual_inc_joint', 'pass__dti_joint', 'pass__verification_status_joint', 'pass__inq_fi', 'pass__inq_last_12m', 'pass__chargeoff_within_12_mths', 'pass__mort_acc', 'pass__pub_rec_bankruptcies', 'pass__tax_liens', 'pass__tot_hi_cred_lim', 'pass__total_bal_ex_mort'], dtype='object')

Pipeline(steps=[('preprocessing',
                 FunctionTransformer(func=<function convert_to_category at 0x7fbf14075240>)),
                ('feat_trans_dti_inc_joint',
                 JointApplicationTransformer(option=<Options.MERGE_JOINT_FIELDS: 1>)),
                ('feat_trans_fico_score', FICOScoreTransformer()),
                ('feat_trans_delinquency', DelinquencyTransformer()),
                ('feat_trans_inst_income_ratio', InstallementInc...
                               feature_types=None, gamma=0.05, grow_policy=None,
                               importance_type=None,
                               interaction_constraints=None, learning_rate=0.3,
                               max_bin=None, max_cat_threshold=None,
                               max_cat_to_onehot=None, max_delta_step=None,
                               max_depth=None, max_leaves=None,
                               min_child_weight=2.5, missing=nan,
                               monotone_constraints=None, multi_strategy=None,
                               n_estimators=150, n_jobs=None,
                               num_parallel_tree=None,
                               objective='multi:softprob', ...))])

In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.

2171294    2
1220320    0
867962     2
583827     2
492852     2
          ..
1280900    0
1119446    0
186694     1
317585     2
1747982    1
Length: 4500, dtype: int64

<seaborn.axisgrid.JointGrid at 0x7fbef834af80>

Text(0.5, 1.0, 'Your Title Here')

---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
Cell In[22], line 1
----> 1 predictions_rounded = cv_results_all_models['XGBoostOrdinalRegressor_Default'].test_data.predictions
      2 predictions_rounded

KeyError: 'XGBoostOrdinalRegressor_Default'

Calculating Probability Thresholds

If we're using our binary classification model to assign grades to loans based on default probabilities we can't directly try to predict the grades from the source dataset.

Basically what we can do is to use the source dataset as a baseline and try to determine whether our model can outperform the method the Lending Club is using for determine grades, we'll try to maintain the same ratio of grades while trying to minimize the default risk for loans included in top grades (basically we want to make sure that's the spread of default risk between grades is maximized i.e. default risk for grade A is as close to 0% and for grade F as close to 100% as possible while also ensuring that the risk increased with continuously with grade)

Limitations

We must take into account that this calculation is very simplified and therefore probably not accurate because, our model and calculations assume that Loss Given Default (LGD) is 100% and that Exposure at Default (EAD) is also 100% which is not accurate: - loans usually are not defaulted on immediately (i.e. some payments are almost always received) - most applicants who are unable to keep up with their payments are given some leeway and {PAYMENT PLAN} - failed loans are often sold to third parties for at least some fraction of the owed amount

Therefore, to provide a more accurate estimate and to figure out whether our model would actually be useful we'd need to incorporate the actual amounts received etc.

TODO: consider doing this (we'd just need to use the appropriate column from the df)

Total samples loaded : 9000

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/preprocessing/_function_transformer.py:345: UserWarning: With transform="pandas", `func` should return a DataFrame to follow the set_output API.
  warnings.warn(

1    2673
2    2593
0    1713
3    1268
4     539
5     160
6      54
Name: target__grade, dtype: int64

Tunning: - transformers: transformers: 7
 total options: 14
[<class 'src.feature_engineering.JointApplicationTransformer'>, <class 'src.feature_engineering.FICOScoreTransformer'>, <class 'src.feature_engineering.DelinquencyTransformer'>, <class 'src.feature_engineering.InstallementIncomeRatio'>, <class 'src.feature_engineering.NewDtiTransformer'>, <class 'src.feature_engineering.DummyDropAllButFICOHigh'>, <class 'shared.ml_config_core.DummyTestTransformer'>]
search_grid:
{'feat_trans_dti_inc_joint__option': [0, 1], 'feat_trans_fico_score__option': [0, 1], 'feat_trans_delinquency__option': [0, 1], 'feat_trans_inst_income_ratio__option': [0, 1], 'feat_trans_new_dti_after_loan__option': [0, 1], 'feat_trans_dummy_DROP_ALL_BUT_FICO_HIGH__option': [0, 1], 'feat_trans_dummytransformer__option': [0, 1]}

 - model: XGBoostTuneLogLossGradeClass n_iters=100 with:
 {'model__learning_rate': [0.01, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.9, 1], 'model__max_depth': [4, 5, 6, 7, 10, 12, None], 'model__n_estimators': [50, 100, 150, 200, 250], 'model__min_child_weight': [0.1, 0.25, 0.5, 0.75, 1, 1.5, 2, 2.5, 3], 'model__gamma': [0, 0.05, 0.1, 0.3, 0.4], 'model__scale_pos_weight': [1, 2, 3, 5, 10]}
Fitting 3 folds for each of 128 candidates, totalling 384 fits

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:07] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:07] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:07] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:07] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:07] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:07] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:08] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:08] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:16] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:16] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:16] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:16] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:17] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:17] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:17] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:17] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:20] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:20] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:20] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:20] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:22] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:22] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:22] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:23] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:23] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:23] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:23] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:23] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:23] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:23] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:24] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:24] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:24] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:24] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:24] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:24] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:25] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:25] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:25] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:25] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:25] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:25] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:25] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:26] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:26] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:26] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:26] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:26] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:27] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:27] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:27] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:27] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:27] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:27] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:28] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:28] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:34] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:34] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:34] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:35] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:35] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:35] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:35] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:35] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:42] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:42] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:42] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:42] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:42] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:42] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:43] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:43] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:49] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:50] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:50] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:50] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:50] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:50] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:50] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:50] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:51] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:51] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:51] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:51] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:51] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:51] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:52] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:52] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:52] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:52] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:52] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:53] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:53] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:53] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:53] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:53] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:53] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:54] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:55] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:55] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:55] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:55] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:55] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:55] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:56] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:56] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:56] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:56] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:56] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:56] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:57] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:57] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:57] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:57] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:58] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:58] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:58] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:58] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:58] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:58] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:59] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:23:59] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:06] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:06] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:06] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:06] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:06] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:06] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:07] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:07] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:08] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:08] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:08] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:09] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:10] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:10] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:10] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:10] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:12] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:12] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:12] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:12] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:13] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:13] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:13] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:13] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:15] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:16] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:16] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:16] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:16] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:16] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:17] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:17] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:17] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:18] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:19] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:19] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:19] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:19] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:20] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:20] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:20] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:20] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)
/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/xgboost/core.py:160: UserWarning: [16:24:21] WARNING: /home/conda/feedstock_root/build_artifacts/xgboost-split_1703076519788/work/src/learner.cc:742: 
Parameters: { "scale_pos_weight" } are not used.

  warnings.warn(smsg, UserWarning)

KeyboardInterrupt

/home/paulius/miniconda3/envs/rapids_v2/lib/python3.10/site-packages/sklearn/preprocessing/_function_transformer.py:345: UserWarning: With transform="pandas", `func` should return a DataFrame to follow the set_output API.
  warnings.warn(

None

	term_parser__term	emp_length_parser__emp_length	target__loan_status	pass__loan_amnt	pass__int_rate	pass__installment	pass__grade	pass__sub_grade	pass__home_ownership	pass__annual_inc	...	pass__dti_joint	pass__verification_status_joint	pass__inq_fi	pass__inq_last_12m	pass__chargeoff_within_12_mths	pass__mort_acc	pass__pub_rec_bankruptcies	pass__tax_liens	pass__tot_hi_cred_lim	pass__total_bal_ex_mort
1655442	36	10.0	0.0	16000.0	10.49	519.97	B	B2	MORTGAGE	81000.0	...	NaN	None	2.0	6.0	0.0	3.0	0.0	0.0	191955.0	24736.0

1 rows × 43 columns

['term_parser__term',
 'emp_length_parser__emp_length',
 'pass__loan_amnt',
 'pass__int_rate',
 'pass__installment',
 'pass__grade',
 'pass__sub_grade',
 'pass__home_ownership',
 'pass__annual_inc',
 'pass__verification_status',
 'pass__purpose',
 'pass__zip_code',
 'pass__addr_state',
 'pass__dti',
 'pass__delinq_2yrs',
 'pass__fico_range_low',
 'pass__fico_range_high',
 'pass__inq_last_6mths',
 'pass__mths_since_last_delinq',
 'pass__mths_since_last_record',
 'pass__open_acc',
 'pass__pub_rec',
 'pass__revol_bal',
 'pass__revol_util',
 'pass__total_acc',
 'pass__initial_list_status',
 'pass__last_fico_range_high',
 'pass__last_fico_range_low',
 'pass__collections_12_mths_ex_med',
 'pass__mths_since_last_major_derog',
 'pass__application_type',
 'pass__verification_status_joint',
 'pass__inq_fi',
 'pass__inq_last_12m',
 'pass__chargeoff_within_12_mths',
 'pass__mort_acc',
 'pass__pub_rec_bankruptcies',
 'pass__tax_liens',
 'pass__tot_hi_cred_lim',
 'pass__total_bal_ex_mort',
 'new_dti',
 'purpose_risk_score']

pass__last_fico_range_high: 0.337980180978775
term_parser__term: 0.03251992538571358
pass__loan_amnt: 0.02825065515935421
pass__sub_grade: 0.02807643823325634
pass__addr_state: 0.02798895165324211
pass__zip_code: 0.027812838554382324
pass__inq_last_6mths: 0.022738995030522346
pass__mths_since_last_major_derog: 0.022662928327918053
pass__total_acc: 0.022479671984910965
pass__tax_liens: 0.022230030968785286
purpose_risk_score: 0.02119610831141472
new_dti: 0.020708099007606506
pass__inq_last_12m: 0.020010223612189293
pass__inq_fi: 0.019915791228413582
pass__annual_inc: 0.019756585359573364
pass__purpose: 0.01971934363245964
pass__mths_since_last_record: 0.019092557951807976
pass__grade: 0.018701616674661636
pass__installment: 0.01683032512664795
pass__open_acc: 0.016673553735017776
pass__total_bal_ex_mort: 0.016378113999962807
pass__tot_hi_cred_lim: 0.01600806415081024
pass__verification_status: 0.015962135046720505
pass__fico_range_low: 0.015944261103868484
pass__int_rate: 0.01580692268908024
pass__dti: 0.015423598699271679
pass__revol_util: 0.015189597383141518
pass__mths_since_last_delinq: 0.015159785747528076
emp_length_parser__emp_length: 0.014573454856872559
pass__mort_acc: 0.014246702194213867
pass__revol_bal: 0.013651103712618351
pass__home_ownership: 0.012917285785079002
pass__verification_status_joint: 0.01244024932384491
pass__initial_list_status: 0.012202776037156582
pass__delinq_2yrs: 0.00835102517157793
pass__pub_rec: 0.007155079394578934
pass__pub_rec_bankruptcies: 0.007014576345682144
pass__collections_12_mths_ex_med: 0.006230466067790985
pass__fico_range_high: 0.0
pass__last_fico_range_low: 0.0
pass__application_type: 0.0
pass__chargeoff_within_12_mths: 0.0

['term_parser__term',
 'emp_length_parser__emp_length',
 'pass__loan_amnt',
 'pass__int_rate',
 'pass__installment',
 'pass__grade',
 'pass__sub_grade',
 'pass__home_ownership',
 'pass__annual_inc',
 'pass__verification_status',
 'pass__purpose',
 'pass__zip_code',
 'pass__addr_state',
 'pass__dti',
 'pass__delinq_2yrs',
 'pass__fico_range_low',
 'pass__fico_range_high',
 'pass__inq_last_6mths',
 'pass__mths_since_last_delinq',
 'pass__mths_since_last_record',
 'pass__open_acc',
 'pass__pub_rec',
 'pass__revol_bal',
 'pass__revol_util',
 'pass__total_acc',
 'pass__initial_list_status',
 'pass__last_fico_range_high',
 'pass__last_fico_range_low',
 'pass__collections_12_mths_ex_med',
 'pass__mths_since_last_major_derog',
 'pass__application_type',
 'pass__verification_status_joint',
 'pass__inq_fi',
 'pass__inq_last_12m',
 'pass__chargeoff_within_12_mths',
 'pass__mort_acc',
 'pass__pub_rec_bankruptcies',
 'pass__tax_liens',
 'pass__tot_hi_cred_lim',
 'pass__total_bal_ex_mort',
 'new_dti',
 'purpose_risk_score']

array([0.03251993, 0.01457345, 0.02825066, 0.01580692, 0.01683033,
       0.01870162, 0.02807644, 0.01291729, 0.01975659, 0.01596214,
       0.01971934, 0.02781284, 0.02798895, 0.0154236 , 0.00835103,
       0.01594426, 0.        , 0.022739  , 0.01515979, 0.01909256,
       0.01667355, 0.00715508, 0.0136511 , 0.0151896 , 0.02247967,
       0.01220278, 0.33798018, 0.        , 0.00623047, 0.02266293,
       0.        , 0.01244025, 0.01991579, 0.02001022, 0.        ,
       0.0142467 , 0.00701458, 0.02223003, 0.01600806, 0.01637811,
       0.0207081 , 0.02119611], dtype=float32)

array([0.03251993, 0.01457345, 0.02825066, 0.01580692, 0.01683033,
       0.01870162, 0.02807644, 0.01291729, 0.01975659, 0.01596214,
       0.01971934, 0.02781284, 0.02798895, 0.0154236 , 0.00835103,
       0.01594426, 0.        , 0.022739  , 0.01515979, 0.01909256,
       0.01667355, 0.00715508, 0.0136511 , 0.0151896 , 0.02247967,
       0.01220278, 0.33798018, 0.        , 0.00623047, 0.02266293,
       0.        , 0.01244025, 0.01991579, 0.02001022, 0.        ,
       0.0142467 , 0.00701458, 0.02223003, 0.01600806, 0.01637811,
       0.0207081 , 0.02119611], dtype=float32)

1

	term_parser__term	emp_length_parser__emp_length	target__loan_status	pass__loan_amnt	pass__int_rate	pass__installment	pass__grade	pass__sub_grade	pass__home_ownership	pass__annual_inc	...	pass__dti_joint	pass__verification_status_joint	pass__inq_fi	pass__inq_last_12m	pass__chargeoff_within_12_mths	pass__mort_acc	pass__pub_rec_bankruptcies	pass__tax_liens	pass__tot_hi_cred_lim	pass__total_bal_ex_mort
1655442	36	10.0	0.0	16000.0	10.49	519.97	B	B2	MORTGAGE	81000.0	...	NaN	None	2.0	6.0	0.0	3.0	0.0	0.0	191955.0	24736.0

1 rows × 43 columns

array([[9.9977344e-01, 2.2654343e-04]], dtype=float32)

term_parser__term                                 36
emp_length_parser__emp_length                   10.0
target__loan_status                              0.0
pass__loan_amnt                              16000.0
pass__int_rate                                 10.49
pass__installment                             519.97
pass__grade                                        B
pass__sub_grade                                   B2
pass__home_ownership                        MORTGAGE
pass__annual_inc                             81000.0
pass__verification_status            Source Verified
pass__purpose                            credit_card
pass__zip_code                                 380xx
pass__addr_state                                  TN
pass__dti                                      11.31
pass__delinq_2yrs                                0.0
pass__fico_range_low                           685.0
pass__fico_range_high                          689.0
pass__inq_last_6mths                             2.0
pass__mths_since_last_delinq                    29.0
pass__mths_since_last_record                     NaN
pass__open_acc                                  11.0
pass__pub_rec                                    0.0
pass__revol_bal                              19162.0
pass__revol_util                                45.1
pass__total_acc                                 18.0
pass__initial_list_status                          w
pass__last_fico_range_high                     739.0
pass__last_fico_range_low                      735.0
pass__collections_12_mths_ex_med                 0.0
pass__mths_since_last_major_derog                NaN
pass__application_type                    Individual
pass__annual_inc_joint                           NaN
pass__dti_joint                                  NaN
pass__verification_status_joint                  NaN
pass__inq_fi                                     2.0
pass__inq_last_12m                               6.0
pass__chargeoff_within_12_mths                   0.0
pass__mort_acc                                   3.0
pass__pub_rec_bankruptcies                       0.0
pass__tax_liens                                  0.0
pass__tot_hi_cred_lim                       191955.0
pass__total_bal_ex_mort                      24736.0
Name: 1655442, dtype: object